Job management system for automated data collection from the Internet

This work is devoted to the research and development of a task management system for automated data collection from Internet. article contains description implemented methodologies tells about techniques created by interacting with containers containing applications. In course work, various existing services Internet were studied presented: ready-made open source solutions, cloud extensive functionality, as well our own solution running Kubernetes. As result was Talisman analysis platform, which provides horizontal scalability, isolation crawler environment independence technology their development.